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Abstract 

Higher-order Fourier analysis, developed over prime fields, has been recently used in different 
areas of computer science, including list decoding, algorithmic decomposition and testing. We 
extend the tools of higher-order Fourier analysis to analyze functions over general fields. Using 
these new tools, we revisit the results in the above areas. 

(i) For any fixed finite field K, we show that the list decoding radius of the generalized Reed 
Muller code over K equals the minimum distance of the code. Previously, this had been 
proved over prime fields [BL14] and for the case when |IK| — 1 divides the order of the code 
[GKZ08]. 

(ii) For any fixed finite field K, we give a polynomial time algorithm to decide whether a given 
polynomial P : K" K can be decomposed as a particular composition of lesser degree 
polynomials. This had been previously established over prime fields [Bhal4, BHT15]. 

(iii) For any fixed finite field K, we prove that all locally characterized affine-invariant properties 
of functions / : K" ^ K are testable with one-sided error. The same result was known 
when K is prime [BFH'''13] and when the property is linear [KS08]. Moreover, we show 
that for any fixed finite field F, an affine-invariant property of functions / : K" —>■ F, where 
K is a growing field extension over F, is testable if it is locally characterized by constraints 
of bounded weight. 


1 Introduction 

Fourier analysis over finite groups has played a central role in the development of theoretical 
computer science. Examples of its applications are everywhere: analysis of random walks on 
graphs [CDG87], fast integer multiplication algorithms [SS71], learning algorithms [KM93a], the 
Kahn-Kalai-Linial theorem [KKL88], derandomization [NN93], tight inapproximability results using 
probabilistically checkable proofs [HasOl], social choice theory [MOOlO], and coding theory [NS05]. 
See the surveys of De Wolf [dW08] and Stefankovic [SteOO]. 

Higher-order Fourier analysis is a recent generalization of some aspects of Fourier analysis. 
Consider functions over the integers Z. While classical Fourier analysis over Z studies correlations 
of functions with linear phases higher-order Fourier analysis over Z analyzes the correlation of 
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functions with polynomial phases such as . The modern^ work on higher-order Fourier analysis 
over Z began with the spectacular proof by Gowers of Szemeredi’s theorem [Gow98, GowOl], where 
the Gowers norm was introduced, and with the ergodic theory work of Host and Kra [HK05]. 
Snbseqnently, Green, Tao and Ziegler through several works [GT08, GTIO, GTZll, GTZ12] largely 
completed the research program of understanding the relationships between different aspects of 
the theory over Z. This work was applied to solve several longstanding open problems in additive 
number theory, including the celebrated result showing the existence of arbitarily long arithmetic 
progressions in the primes [GTIO]. The book [Taol2] by Tao on the subject surveys the current 
state of knowledge. 

In an influential article [Gre05], Green popularized the idea that it is useful to rephrase the 
problems arising in additive nnmber theory into problems on vector spaces over fixed finite helds. 
The motivation was that many of the techniqnes in higher-order Fourier analysis over Z simplify 
over finite fields, because of the presence of subspaces and of algebraic notions such as orthogonality 
and linear independence. However, it was soon realized that these qnestions over finite helds are also 
intrinsically interesting because of their connections to theoretical computer science. In particnlar, 
the Gowers norm for fnnctions on for a hnite prime held F is directly related to low-degree 
testing, a problem intensely studied by computer scientists since the early 90’s. 

Thanks to the sequence of works [GT09, KL08, TZIO, BTZIO, TZ12], the apparatus of higher- 
order Fourier analysis over F” for any hxed prime order held F is also now largely complete. The 
theory has subsequently fonnd several interesting applications in computer science that we detail 
below and has become part of the mainstream theorist toolkit. However, in all of these applications, 
the hnite held in consideration was restricted to be a held of prime order, while the problems 
themselves are interesting over general hnite helds. In this work, we show how the techniques 
of higher-order Fourier analysis continue to apply even when the underlying held is a non-trivial 
extension of a prime order held. 

1.1 Applications 

In this section, we describe three different problems involving a hnite held IK, which previonsly had 
been solved only when [IK] was prime but which we can now solve for arbitrary hnite IK. 

Thronghont, let F be a hxed prime order held, and let IK be a hnite held that extends F. Let 
q = jlKj, p = |F| and q = for r > 0. 

1.1.1 List-decoding Reed-Muller codes 

The notion of list deeoding was introdnced by Elias [Eli57] and Wozencraft [Woz58] to decode error 
correcting codes beyond half the minimum distance. The goal of a list decoding algorithm is to 
produce all the codewords within a specihed distance from the received word. At the same time one 
has to hnd the right radins for which the nnmber of snch codewords is small, otherwise there is no 
hope for the algorithm to be efficient. After the seminal resnlts of Goldreich and Levin [GL89] and 
Sndan [Sud97] which gave list decoding algorithms for the Hadamard code and the Reed-Solomon 
code respectively, there has been tremendous progress in designing list decodable codes. See the 
survey by Guruswami [GurOG, Gur04] and Sudan [SudOO]. 

List decoding has applications in many areas of compnter science including hardness amplifi¬ 
cation in complexity theory [STVOl, Tre03], derandomization [Vadl2], constrnction of hard core 

^In retrospect, Weyl’s results on equidistribution of polynomial phases [Weyl4] laid the foundations of this theory. 
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predicates from one way functions [GL89, AGS03], construction of extractors and pseudorandom 
generators [TSZSOl, SU05] and computational learning [KM93b, Jac97]. However, the largest ra¬ 
dius up to which list decoding is tractable is still a fundamental open problem even for well studied 
codes like Reed-Solomon (univariate polynomials) and Reed-Muller codes (multivariate polynomi¬ 
als). The goal of this work is to analyse Reed-Muller codes over small fields (possible non prime) 
and small degree. 

Reed-Muller codes (RM codes) were discovered by Muller in 1954. Let d € N. The RM 
code RMK(n, d) is defined as follows. The message space consists of degree ^ d polynomials in n 
variables over K and the codewords are evaluation of these polynomials on K”. Let 6q{d) denote 
the normalized distance of RMK(n, d). Let d = a{q — 1) +b where 0 ^ 6 < g — 1. We have 



RM codes are one of the most well studied error correcting codes. Many applications in computer 
science involve low degree polynomials over small fields, namely RM codes. Given a received word 
g : K” —>■ K the objective is to output the list of codewords (e.g. low-degree polynomials) that 
lie within some distance of g. Typically we will be interested in regimes where list size is either 
independent of n or polynomial in the block length g"". 

Let denote the class of degree ^ d polynomials / : —)■ F. Let dist denote the 

normalized Hamming distance. For RMK(n,d), g > 0, let 

ev{n,d,r]) := max |{/ G Rd(F’^) : dist(/,g) ^ r/}| . 

Let LDRK(n, d) (short for list decoding radius) be the maximum p for which %(n, d, p — e) is upper 
bounded by a constant depending only on e, \K\,d for all e > 0. 

It is easy to see that LDR]K(n, d) ^ hK(d). The difficulty lies in proving a matching lower 
bound. We review some previous work next. The first breakthrough result was the celebrated work 
of Goldreich and Levin [GL89] who showed that in the setting of d = 1 over F 2 (Hadamard Codes) 
LDR]F 2 (n, 1) = dF 2 (l) = 1/2- Later, Goldreich, Rubinheld and Sudan [GRSOO] generalized the field 
to obtain LDRK(n, 1) = dK(l) = 1 — In the setting of d < |K|, Sudan, Trevisan and Vadhan 

[STVOl] showed that LDR]K(n,d) ^ 1 — y^2d/|]K| improving previous work by Arora and Sudan 
[AS03], Goldreich et al [GRSOO] and Pellikaan and Wu [PW04]. Note that this falls short of the 
upper bound which is diK(d). 

In 2008, Gopalan, Klivans and Zuckerman [GKZ08] showed that LDRF 2 (u,d) = (5F2(d).They 
posed the following conjecture. 

Conjecture 1.1 ([GKZ08]). For fixed d and finite field K, LDRK(n, d) = dK(d). 

It is believed [GKZ08, GoplO] that the hardest case is the setting of small d. An important 
step in this direction was taken in [GoplO] that considered quadratic polynomials and showed that 
LDRK(n, 2) = dK(2) for all fields K and thus proved the conjecture for d = 2. Recently, Bhowmick 
and Lovett [BL14] resolved the conjecture for prime IK. 

Our main result for list decoding is a resolution of Conjecture 1.1. 

Theorem 1.1. Let IK 6e a finite field. Let e > 0 and d, n G N. Then, 


£iK(d,n,dK(d) -£) ^ C|K|,d,£. 
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Thus. 


LDRK(n,d) = (5 k (d). 

Remark 1.2 (Algorithmic Implications). Using the blackbox reduction of algorithmic list decoding 
to combinatorial list decoding in [GKZ08J along with Theorem 1 . 1 , for fixed finite fields, d and 
e > 0 , we now have list decoding algorithms in both the global setting (running time polynomial in 
and the local setting (running time polynomial in n'^). 

1.1.2 Algorithmic polynomial decomposition 

Consider the following family of properties of functions over a finite field K. 

Definition 1.3. Given a positive integer k, a vector of positive integers A = (Ai, A 2 ,..., A^) and 
a function F : —>■ K., we say that a function P : K” ^ K is (A:, A, r)-structured if there exist 

polynomials Pi, P 2 , ■ ■ ■, Pk ■ IK” —>■ IK with each deg(Pi) ^ Aj such that for all x ^ K"', 

P{x)=r{Pi{x),P 2 {x),...,Pk{x)). 

The polynomials Pi, ■ ■ ■, Pk are said to form a {k. A, r)-decomposition. 

For instance, an n-variate polynomial over the field IK of total degree d factors nontrivially 
exactly when it is (2, {d — l,d— 1), prod)-structured where prod(a, b) = a-b. We shall use the term 
degree-structural property to refer to a property from the family of {k, A, r)-structured properties. 

The problem here is, for arbitrary fixed k, IK, (A), F, given a polynomial, decide efficiently if it is 
degree structural and if yes, output the decomposition. An efficient algorithm for the above would 
imply a (deterministic) poly(n)-time algorithm for factoring an n-variate polynomial of degree d 
over IK. Also, it implies a polynomial time algorithm for deciding whether a d-dimensional tensor 
over IK has rank at most r. Also, it would give polynomial time algorithms for a wide range 
of problems not known to have non-trivial solutions previously, such as whether a polynomial of 
degree d can be expressed as Pi ■ P 2 + P 3 ■ Pa where each Pi, P 2 , P 3 , Pa are of degree d — 1 or less. 

This problem was solved for prime IK, satisfying d < |F| by Bhattacharyya [Bhal4] and later 
for all d and prime |1K| by Bhattacharyya, Hatami and Tulsiani [BHT15]. 

Our main result in this line of work establishes this for all fixed finite fields. 

Theorem 1.4. For every finite field IK, positive integers k and d, every vector of positive integers 
A = (Ai, A 2 ,..., Afc) and every function F : —)• IK, there is a deterministic algorithm AK,d,fc,A,r 

that takes as input a polynomial P : IK"" M. of degree d that runs in time polynomial in n, and 
outputs a {k, ^,V)-decomposition of P if one exists while otherwise returning NO. 

1.1.3 Testing affine-invariant properties 

The goal of property testing, as initiated by [BLR93, BFL91] and defined formally by [RS96, 
GGR98], is to devise algorithms that query their input a very small number of times while correctly 
deciding whether the input satisfies a given property or is “far” from satisfying it. A property is 
called testable if the query complexity can be made independent of the size of the input. 

More precisely, we use the following definitions. Let [R] denote the set {1,...,R}. Given a 
property V of functions in {IK” —>■ [R] | n € we say that / ; IK” — [R] is £-far from V if 

minPr,EGiK~[/(a;) + g{x)] > e, 

g&V 

and we say that it is e-close otherwise. 
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Definition 1.5 (Testability). A property V is said to be testable (with one-sided error) if there 
are functions q : (0,1) —>■ Z>o, S : (0,1) —>■ (0,1), and an algorithm T that, given as input a 
parameter e > 0 and oracle access to a function f : K” —)■ [12], makes at most q{e) queries to the 
oracle for f, always accepts if f € V and rejects with probability at least 6{e) if f is e-far from V. 
If, furthermore, q is a constant function, then V is said to he proximity-obliviously testable (PO 
testable). 

The term proximity-oblivious testing is coined by Goldreich and Ron in [GRll]. As an example 
of a testable (in fact, PO testable) property, let us recall the famous result by Blum, Luby and 
Rubinfeld [BLR93] which initiated this line of research. They showed that linearity of a function 
/ : K” —>■ K is testable by a test which makes 3 queries. This test accepts if / is linear and rejects 
with probability fl(e) if / is e-far from linear. 

Linearity, in addition to being testable, is also an example of a linear-invariant property. We say 
that a property V T {K"' —[R]} is linear-invariant if it is the case that for any / G P and for any K- 
linear transformation L : IK”’ —)• MA, it holds that / oL G P. Similarly, an affine-invariant property 
is closed under composition with affine transformations A : K"' —>■ MA (an affine transformation 
A is of the form L -\- c where L is K-linear and c G IK). The property of a function / : IK"" —K 
being affine is testable by a simple reduction to [BLR93], and is itself affine-invariant. Other well- 
studied examples of affine-invariant (and hence, linear-invariant) properties include Reed-Muller 
codes [BFL91, BFLS91, FGL+96, RS96, AKK+05] and Fourier sparsity [GOS+09]. In fact, affine 
invariance seems to be a common feature of most interesting properties that one would classify as 
“algebraic”. Kaufman and Sudan in [KS08] made explicit note of this phenomenon and initiated a 
general study of the testability of affine-invariant properties (see also [GKll]). 

Our main theorem for testing is a very general positive result: 

Theorem 1.6 (Main testing result). Let V C {K” [R]} he an affine-invariant property that is 

t, w-lightly locally characterized, where t, R, w, and char(]K) are fixed positive integers. Then, V is 
PO testable with t queries. 

We are yet to define several terms in the above claim, but as we will see, the weight restriction 
is trivial when the field size is bounded. This yields the following characterization. 

Theorem 1.7 (Testing result for fixed fields). Let P C {K”' ^ [R]} be an affine-invariant property, 
where R G and field K are fixed. Then, V is PO testable with t queries if and only ifV is t-locally 

characterized. 

Previously, [BFH'''13] (building on [BGSXll, BGSIO, BFL13]) proved Theorem 1.6 in the case 
that IK is of fixed prime order using higher-order Fourier analytic techniques. We note that other 
recent results on 2-sided testability of affine-invariant properties over fixed prime-order fields [HL13, 
Yosl4] can also be similarly extended to non-prime fields but we omit their description here. 

Local Characterizations For a PO testable property P C {IK"^ —>■ [R]} of query complexity t, if 
a function / : IK*^ ^ [R] does not satisfy P, then by Definition 1.5, the tester rejects / with positive 
probability. Since the test always accepts functions with the property, there must be t points 
ui,..., at G IK” that form a witness for non-membership in P. These are the queries that cause the 
tester to reject. Thus, denoting a = (/(ai),...,/(at)) G [R]*, we say that C = (ai, 02 ,..., ot; a) 
forms a t-local constraint for P. This means that whenever the constraint is violated by a function 
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g, i.e., {g{ai),... ,g{at)) = a, we know that g is not in V. A property V is t-locally characterized if 
there exists a collection of t-local constraints Ci,, Cm such that g \i and only if none of the 
constraints Ci,... ,Cm are violated. It follows from the above discussion that if V is PO testable 
with q queries, then V is t-locally characterized. 

For an affine-invariant property, constraints can be defined in terms of affine forms, since the 
affine orbit of a constraint is also a constraint. So, we can describe each t-local constraint C as 
(Ai,..., At] a), where for every f G [t], Aj(Xi,..., Xt) = Xi + Yl ]=2 some Cjj G K is an 

affine form over K. We define the weight wt of an element c G IC as \^k\, where c is viewed as 

an r-dimensional vector (ci,..., c^) with each c* in the base prime field^ F with respect to a fixed 
arbitrary basis. The weight of an affine form Ai to be ^i,j above. A constraint 

is said to be of weight w if all its affine forms are of weight at most w, and a property V is said 
to be t, tc-lightly localyl characterized if there exist t-local constraints Ci,..., Cm, each of weight at 
most w that characterize V. 

Theorem 1.6 asserts that if V has a light local characterization, then it is testable. There can 
exist many local characterizations of a property, and for the theorem to apply, it is only necessary 
that one such characterization be of bounded weight. Moreover, we can choose the basis with which 
to describe K over F. On the other hand, some restriction in addition to local characterization is 
needed, as Ben-Sasson et al. [BMSSll] show that there exist affine-invariant locally characterized 
properties of functions / : F 2 ^ —F 2 that require super-constant query complexity to test. 

Another interesting observation is that if a property has a local characterization of bounded 
weight, then it has a local single orbit characterization, in the language of [KS08]. For linear^ affine- 
invariant properties, [KS08] shows that any local single orbit characterized property is testable. 
Hence, our result is weaker than [KS08] in this aspect, though our Theorem 1.6 allows non-linear 
properties. It is an interesting open question as to whether dual-BCH codes and, more generally, 
sparse affine-invariant codes that were shown to be locally single orbit characterized in [KL05] 
and [GKS12] respectively also have local characterizations of bounded weight. It is also an open 
problem to describe a testable property V C {F 2 » —>■ F 2 } that does not have a local characterization 
of bounded weight. 

1.2 Our Techniques 
1.2.1 New Ingredients 

Our starting point is the observation that K is an r-dimensional vector space over F. Thus, we can 
view a function Q : K.”' —K as determined by a collection of functions Pi,... ,Pr : IK"' —)• F where 
IK" is viewed as F'’". In view of this, we define the notion of an additive polynomial. A function^ 
P : IK" —>■ F is said to have additive degree d if for all /ii,..., hd+i G IK", = 0, where 

{DfiP){x) = P{x + h) — P{x). Additive polynomials are exactly the non-classical polynomials of 
[TZ12] when the domain is F^". Moreover, if Q : IK" —)• IK has degree d (in the usual sense of having 
a monomial with degree d), then Tr(aQ) has additive degree ^ d for any a G IK where Tr : IK ^ F 
denotes the trace function. 

a; £ F, \x\ is the obvious element of {0,1,..., |F| — 1}. 

^These are properties of functions / : K" —>■ F, where F is a subfield of K, for which f,g€V implies af + Pg 
for any a, /3 £ F. 

^To deal with low characteristics, we will actually use a slightly general definition valid for functions mapping to 
the torus R/Z. 
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Therefore, we can directly write any polynomial P : K"" ^ K in terms of additive polynomials 
and then import all of the results shown in [TZ12] for non-classical polynomials to our setting! 
Unfortunately, we are not done. The reason is that our applications require, in addition to additive 
structure, some of the multiplicative structure of K, which is lost when we view K as F'’. 

To see why, recall the question of testing affine-invariant properties. When K is of bounded 
order, we can view any one-sided test as examining the restriction of the input function on a random 
X-dimensional affine subspace of for some constant integer K. In other words, the test will 
evaluate the input function at elements of the set H = {x + : oi,..., qk S IK} for some 

x,yi,... ,yK G IK. Clearly, H is not an affine subspace of F^"'. An important component of the 
higher-order Fourier analytic approach is to show that any “sufficiently pseudorandom” collection 
of polynomials is equidistributed on and the proof of this fact in [BFH+13] crucially uses that 
FI is a subspace of a vector space over a prime field. In our work, we show a strong equidistribution 
theorem (Theorem 3.3) that holds when H is an affine subspace of IK”. 

A different place where multiplicative structure rears its head is a key Degree Preserving Lemma 
of [BFH'''13]. Informally, it states that if Pi,..., Pc form a “sufficiently pseudorandom” collection 
of polynomials and F{x) = F(Pi(a:),..., Pc{x)) is a polynomial of degree d where F is an arbitrary 
composition function, then for any other collection of polynomials Qi, ■ ■ ■ ,Qc where deg(( 5 i) ^ 
deg(Pj) for every i, G{x) = F((5i(x),..., Qc{x)) also has degree ^ d. The lemma is crucially used 
for the analysis of the Reed-Muller list decoding bound in [BL14] and the polynomial decomposition 
algorithm in [Bhal4, BHT15]. Its proof goes via showing that if all {d + 1) iterated derivatives of 
F : IK” —>■ IK vanish, then so must all {d + 1) iterated derivatives of G : IK” —K. However, when 
|IK| is non-prime, all {d -|- 1) iterated derivates of a function G : K” —IK may vanish without the 
degree being ^ d; consider for example the polynomial which vanishes after only 2 derivatives. 

We resolve this issue by giving a different and more transparent proof of the Degree Preserving 
Lemma, which actually holds in a much more general setting (Theorem 3.4). Using the above 
notation, we prove that if F : IK” —)• IK satisfies some locally characterized property P, then 
G : IK” —>■ IK does also. Since due to a work of Kaufman and Ron [KR06], we know that degree 
is locally characterized, our desired result follows. Our new proof uses our strong equidistribution 
theorem on affine subspaces of IK”. 

An interesting point to note is that both the equidistribution theorem and the degree preserving 
lemma work only assuming that the field characteristic is constant and that the involved affine 
constraints are of bounded weight, without any assumption on the field size. 

1.2.2 Reed-Muller codes 

For a received word g ; IK” —>■ IK our goal is to upper bound |{/ G Vd : dist(/,g) ^ r]}\, where 
V = ^Kid) — £ for some rj > 0 and Vd is the class {Q : IK” ^ IK : deg((5) ^ d}. The proof 
technique is similar in structure as [BL14]. We apply the weak regularity lemma (Corollary 4.1) to 
the received word g : IK” ^ IK and reduce the problem to a structured word g' : IK” ^ IK. More 
specifically, whenever dist{f,g) ^ y, we have dist(/, < 7 ^) ^ r] + £j2. From here, we first express each 
function / : IK” —>■ IK as a linear combination of functions f : K” —>■ F. It can be then shown that 
the analysis in [BL14] works for functions f' : IK” ^ F. A naive recombination of the f : IK” —)■ F 
to / : IK” —>■ IK gives us useful bounds only when d < char(|F|). To circumvent this problem, we 
use our improved degree preserving theorem. This is crucial to our analysis as the technique of 
[BL14] can be used only to analyze the additive degree of polynomials which is not enough for the 
argument to work for arbitrary d and |IK|. 
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1.2.3 Polynomial decomposition 


The algorithm and its analysis follows the lines of [Bhal4, BHT15]. Given a polynomial P : K” —>■ K 
(where |]K| is bounded), we consider the collection of additive polynomials {Tr(Q!iP),... ,Tr(arT’)} 
where oi,... , 0 ^ € IK are linearly independent. We regularize this collection into a pseudorandom 
additive polynomial factor and set one variable to 0 such that the degrees of the polynomials do 
not change. We then recursively solve the problem on n — 1 variables and then apply a lifting 
procedure to get a decomposition for the original problem. A naive analysis of the lifting procedure 
over non-prime fields requires that deg(P) < char(F). In order to get around this, we use our 
improved degree preserving theorem which applies for arbitrary degrees. 

1.2.4 Testing afRne-invariant properties 

Suppose V C {K"' —>■ [R]} is a locally characterized affine-invariant property (where R and char(]K) 
are bounded but n|]K| is growing). Our proof follows the lines of [BGSIO, BFL13, BFH+13]. Suppose 
/ is far from V. We first identify a low-rank function close to / in an appropriate Gowers norm 
which also contains the violation that / contains. Here, low rank is with respect to a collection 
B of additive polynomials. We then investigate the distribution of B on the affine constraint that 
/ violates. Since these are affine with respect to IK"', we need to use our strong equidistribution 
theorem. The rest of the proof proceeds along the same lines as [BFH+13]. 

Because the proof of Theorem 1.6 is very analogous to that in [BFH'^13] (except for the use 
of additive polynomials and the new equidistribution theorem) and requires significant additional 
notation, we omit it here. 

2 Preliminaries 

Let N denote the set of positive integers. For n G N, let [n] := {1,2,..., n}. We use y = x Pe to 
denote y G [x — e,x + e]. For n G N, and x, y G C", let (x, y) := where a is the conjugate 

of a. Let ||x ||2 := \/ (x, x). 

Let T denote the torus R/Z. This is an abelian group under addition. Let e : T —>■ C be the 
function e(x) = For an integer A: ^ 0, let Ufc := ^Z/Z. Note that Ufc is a subgroup of T. 

Let i : F ^ Ui be the bijection i(a) = (mod 1). 

Fix a prime field F = Fp, and let K = Fg where q = for a positive integer r. We denote by 
Tr : K —> F the trace function: 

Tr(x) = X -k x^ -|- x^^ -k • • • -k x^"^ 

Recall that (x —>■ Tr(ox) : a G IK} is in bijection with the set of all linear maps from IK to F. Also, 
we use I • I to denote the obvious map from F to {0,1,... — 1}. We will need the following useful 

fact. 

Proposition 2.1 (Dual basis). For any r linearly independent elements ai,... ,ar G K, there exist 
j3i, (52 ,..., jdr in IK such that any x G IK equals J2i=i /3iTr(aix). 

Given a basis, i.e. collection of r linearly independent field elements, a = (oi,..., a^)) we 
define wt^ : IK —>■ Z to be wtQ;(c) = |Tr(Q:ic)|. 



2.1 AfRne forms and constraints 

A linear form on k variables is a vector L = {wi,W2, ■ ■ ■, Wk) € that is interpreted as a function 
from (]K”')^ to K"" via the map (xi,... ,Xk) i->- wiXi + W2X2 + • • • + w^Xk- A linear form L = 
{wi^W2-, ■ ■ ■ ,Wk) is said to be affine if wi = 1 . Prom now, linear forms will always be assumed to 
be affine. Given a basis a = (ai ,... ,0^), we define wt^ of a linear form L = {wi,... ,Wk) to be 

'Ei=2^tcx{Wi). 

We specify a partial order ^ among affine forms, with respect to a basis a = (ai,..., a^)- We 
say (rci,.. .,Wk) :<a iw[, \Tr:{ajWi)\ ^ \TT:{ajw'f)\ for all i £[k],j € [r]. 

Definition 2.2 (Affine constraints). An affine constraint of size m on k variables is a tuple A = 
{Li,...,Lm) of m affine forms over ¥ on k variables, where: Li{xi,..., Xk) = x\. 

Moreover, it is said to be weight-closed if there exists a basis a = (oi,... , 0 ^) such that for any 
affine form L belonging to A, if L' L, then L' also belongs to A. 

Observe that a weight-closed affine constraint is of bounded size if and only if all its affine forms 
are of bounded weight with respect to some o:. 

2.2 Polynomials, Degrees and Derivatives 

A function P : K."' —>■ K is a polynomial of degree d if for all di,..., ^0 such that di ^ d, 

there exists ^ such that: 

P{xi,...,Xn) = ^ Cd^,... 4 „xf^xf ■■■x'}f 

di,...,dneZ+-. 

dlH- hdn^d 

We use the notion of additive degree for functions mapping to T. Given a function / : K" —>• T, 
its additive derivative in direction h € IK** is Dhf : MA T, given by 

Dhf{x) = f{x + h)- f{x). 


Definition 2.3 (Additive Polynomials). A function P : T is a polynomial of additive degree 

d if for all x,hi,h 2 , ■ ■ ■, hd+i G we have 

Dh^Dh^ ■ ■ ■ D/j^+iP(x) = 0. (1) 

A function of bounded additive degree is called an additive polynomial. 

For functions P mapping to T, deg(P) denotes its additive degree. Note that we can in¬ 
terpret P : K" —)• T as a function P' : —>■ T with the same additive degree by setting 

P{xi,... ,Xn) = P^(Tr(aiXi),...,Tr(Q;ia:i),...,Tr(Q;iXn),...,Tr(Q!ix„)), using Proposition 2.1. 
By this identification, additive polynomials are exactly the same as the non-classical polynomi¬ 
als introduced by Tao and Ziegler [TZ12]. As a consequence, we have the following: 

Lemma 2.4 (Lemma 1.7 of [TZ12]). P : ]K" —T is a polynomial of additive degree d if and only 
if it can he written in the form: 

P{xi,...,Xn) = a + '^ 

Vje[n],jG[r]: 

0 <EiLi dijiid-k(p-l) 


-.1 OLi |Tr(ajXi)|" 


p‘ 


M+i 


(mod 1 ) 
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where a G T and Cd-^ ^ £ {Oj 1) • • • ~ 1} ore uniquely determined, 

there is a nonzero Cdi^i,...,d„^r,k 'Is the depth of P. Note that depth{P) ^ 
at most p'^epi/i(P)+i (iigiijiQf values. 


The maximum k for which 


d-i 

p-i 


and that P takes on 


For a function / : K” —>■ C, define the multiplicative derivative in direction h G to be be 


A/i/(x) = f{x + h) • f{x). 


2.3 Locally Characterized Properties 

As described in the introduction, by a locally characterized property, we informally mean a property 
for which non-membership can be certified by a finite sized witness. Specifically for affine-invariant 
properties, we define: 

Definition 2.5 (Locally characterized properties). 

• An induced affine constraint of size m on i variables is a pair (A, a) where A is an affine 
constraint of size m on I variables and a G [i?]™. 

• Given such an induced affine constraint [A, a), a function f : K"" —>■ [R] is said to be {A,a)- 
free if there exist no xi,..., G MP sueh that (/(Li(xi,..., xi)),..., f{Lm{xi, ..., xe))) = a. 
On the other hand, if such xi,... ,X£ exist, we say that f induces {A, a) at xi,..., 

• Given a (possibly infinite) eollection A = {(A^, cr^), (A^, cr^),..., (A*, cj*),... } of induced 

affine eonstraints, a function f : ^ [R] is said to be A-free if it is {A^,a^)-free for 

every i 1. The size of A is the size of the largest induced affine constraint in A. 

• Additionally, A = {{A^,a 1 ),(A2 , cj^),..., {A^, cr^)} is aW-light affine system if there exists 
a basis a = (oi,..., Or) such that wtct(A*) ^ W for all i G [K]. 

• A property V C {K"' —>■ [R]} is said to be iF, VF-lightly locally characterized if it is equivalent 
to A-freeness for some W-light affine system A whose size is ^ K. 

We recall that Kaufman and Ron [KR06] show that: 

Theorem 2.6 ([KR06]). The property Vd = {P : ^ K : deg(P) ^ d} is q^O+^l/O-g/p)] ^ 

pr\{d + l)/{q — q/p)~\-lightly locally characterized. 


2.4 Factors and Rank 

Next, we define a polynomial factor which forms the basis for much of higher order Fourier analysis. 


Definition 2.7 (Factor). A polynomial factor B is a sequence of additive polynomials Pi,..., Pc ■ 
K.” —> T. We also identify it with the function B : K"" —>■ mapping x to (Pi(x),... , Pc{x)). An 

atom of B is a preimage B~^{y) for some y G When there is no ambiguity, we will in fact 

abuse notation and identify an atom of B with the common value B{x) of all x in the atom. 

The partition induced by B is the partition o/K” given by i^B~^{y) : y G T^}. The complexity 
of B, denoted \B\, is the number of defining polynomials C. The order of B, denoted \\B\\, is the 
total number of atoms in B. The degree of B is the maximum additive degree among its defining 
polynomials Pi,..., Pc. 
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Note that due to Lemma 2.4, if B is defined by polynomials Pi, , Pc, 

c 

||P|| = ]J/epth(P)+i 

i=l 

Definition 2.8 (Rank). Let d G N and P : K.” —^ T. Then rankrf(P) is defined as the smallest 
integer k such that there exist functions Pi,... ,Pk ■ IC” —)• T 0 / additive degree ^ d — 1 and 
a function L ; ^ T such that P{x) = T{Pi{x),..., Pk{x)). If d = 1, then the rank is 0 if 

P is a constant function and is 00 otherwise. If P is a polynomial of additive degree d, then 
rank(P) = rankrf(P). 

Definition 2.9 (Rank and Regularity of Polynomial Factor). Let B be a polynomial factor de¬ 
fined by the sequence Pi,... ,Pc : K” —>■ T with respective depths ki,... ,kc. Then, the rank 
of B is min(aj_ ,j^)rank(^)^^^aiPi) where the minimum is over (ai,... ,ac) G such that (ai 
mod ... ,ac mod 7 ^ (0 ,... , 0) . 

Given a polynomial factor B and a non decreasing function r : ^ Z+, B is r-regular if B is 

of rank at least r{\B\). 

Definition 2.10 (Semantic and Syntactic refinement). Let B and B' be polynomial factors. A 
factor B' is a syntactic refinement of B, denoted by B' Pgyn 13 if the set of polynomials defining B 
is a subset of the set of polynomials defining B'. It is a semantic refinement, denoted by B' Psem 13 
if for every x,y € K", B'{x) = B'{y) implies B{x) = B{y). Clearly, a syntactic refinement is also a 
semantie refinement. 

Our next lemma is the workhorse that allows us to convert any factor into a regular one. 
Lemma 2.11 (Polynomial Regularity Lemma). Let r : TP TP be a non-decreasing function and 
d > 0 be an integer. Then, there is a function ■ TP —>■ TP such that the following is true. 

Suppose B is a factor defined by polynomials Pi,... ,Pc '■ IK"' —>■ T 0 / additive degree at most d. 
Then, there is an r-regular factor B' consisting of polynomials Qi,..., Qc' '■ IK” ^ T 0 / additive 
degree ^ d such that B' Psem 13 and C ^ ' 

Moreover, if B is itself a refinement of some polynomial factor B that has rank > {r{C') + C), 
then additionally B' will be a syntactic refinement of B. 

Proof. Follows directly from Lemma 2.18 of [BFH+13] by identifying K” with F^”. □ 

In fact, the regularization process of Lemma 2.11 can be implemented in time [BHT15]. 


2.5 Gowers norm and the inverse theorem 


Definition 2.12. The bias of a function f : IK” C is defined as bias(/) = |Ea;gK"/(a^)|- For 
P : K” ^ T, we use bias(P) to denote bias(e(P)). 

The Gowers norm of a function measures the bias of its iterated derivative. Precisely: 


Definition 2.13 (Gowers norm). Given a funetion f : K” —)• C and an integer dfil, the Gowers 
norm of order d for f is given by 




hi, 




'^hj){x)] 


1 / 2 ’^ 


//P : K” ^ T, \\P\\ud denotes \\e{P)\\ud. 
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Note that as ||/||[/i = bias(/) the Gowers norm of order 1 is only a semi-norm. However for 
d > 1, it is not difficult to show that || • Wjjd is indeed a norm. 

There is a tight connection between additive polynomials and Gowers norms. In one direction, 
it is a straightforward consequence of the monotonicity of the Gowers norm (||/||; 7 d ^ ||/|li 7 ‘*+i) 
invariance of the Gowers norm with respect to modulation by lower degree polynomials (||/||[/d+i = 
11/ • e(P)||^d+i for polynomials P of additive degree ^ d) that if / : —>■ C is 5-correlated with a 

polynomial P of additive degree ^ d, meaning 

\Ef{x)e{-P{x))\^5 

X 


for some 5 > 0, then 


ll/llf/d+i ^ d. 


In the other direction, we have the following “Inverse theorem for the Gowers norm”. 


Theorem 2.14 (Theorem 1.11 of [TZ12]). Suppose 5 > 0 and d ^ 1 is an integer. There exists an 
e = such that the following holds. For every function f : K"" ^ C with ||/||oo ^ 1 o-n-d 

||/||jjd+i ^ 5, there exists a polynomial P : T of additive degree ^ d that is e-correlated with 

f, meaning 


E /(x)e(-P(x)) 


^ e. 


We can be more explicit when / = e{P) for an additive polynomial P. 

Theorem 2.15 (Theorem 1.20 of [TZ12]). Suppose d > 0 and d ^ 1 is an integer. There exists 
an r = r 2 I 5 (<^j d) such that the following holds. If a polynomial P : K.”' —)■ T with additive degree d 
satisfies HHUf/d ^ 6 , then rank(P) ^ r. 


3 New Tools 

3.1 Equidistribution of regular factors 

Our results in this section imply that a regular polynomial factor is “as random as possible”, subject 
to the additive degree and depth bounds of its defining polynomials. Let us start with the following 
simple observation. 

Lemma 3.1. Given e > 0, let B be a polynomial factor of degree d > 0, complexity C and rank 
r^ l{d,s), defined by a sequence of additive polynomials Pi,..., Pc ■ K” —>■ T having respective 
depths ki,... ,kc. Suppose a = (oi,..., ac) G x • • • x Ufc^+i. Then: 

Prx[B{x) = a\ = ± e. 

Proof. This is standard. See for example Lemma 3.2 of [BFH“^13]. □ 

In our applications though, we will often need not just B{x) to be nearly uniformly distributed 
but the tuple {B{x) : x € H) for a set H C to be nearly uniformly distributed. In particular, 
we consider the case when H is an affine subspace of K". The following lemma is key. 
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Lemma 3.2 (Near orthogonality). Let A = (Li,..., L^) be a weight-closed affine constraint of 
bounded size on I variables. Suppose B is a polynomial factor of degree d and rank ^ 6 ), 

defined by the sequence of additive polynomials Pi, ■ ■ ■ ,Pc ■ K” —)• T. Let A = {Kj)i(^[c],j&[ra] be a 
tuple of integers. Define: 

Pa^xi, ... ,Xk) = ^ XijPi{Lj{xi,... ,xi)). 

ie[c] jG[m] 

Then one of the following is true. 

1. For every i € [c], it holds that Ylje[m] = 0 fox all polynomials Qi : —>■ T with 

the same additive degree and depth as Pi. Clearly, this implies Pa = 0. 

2. Pa ^ 0. Moreover, bias(PA) ^ 5. 

Proof. For j G [m], let ..., wj^t) G denote the affine form given by Lj. Note that wj^i = 1. 

Suppose Q = («!,..., Or) is the basis with respect to which the affine forms are weight-closed. 
For each i, we do the following. If for some j, we have^ \NtffiLj) > deg(AjjPi), Ajj 7 ^ 0, then 
using Proposition 2.1, Lj{xi,..., xfi) = xi + Yfi =2 iYlk=i 'o-i,k ■ fik) Xi where (3 is the dual basis to 
a, each ui^k € [0,p— 1] and Ylik'0'i,k > deg(AijPi). Using Equation (1), we can replace XijPfiLj) 
by a Z-linear combination of PfiLj/) where Lj/ Pa Lj until no such j exists. This is where we 
use the fact that the affine constraint is weight-closed. Suppose the new coefficients are denoted 
by {X'ij). If the XC are all zero, then for every i G [c] individually, Pi{^j{xi,... ,X()) = 0. 

Indeed, 'Yfj£[m] ■ ■ ■ ■:Xi)) = 0 for any Qi with the same additive degree and depth, as the 

transformation from Ajj to X[ j did not use any other information about Pi. 

Else some X[ j 7 ^ 0. Also, wtQ,(Lj) ^ deg(A'^Pj). Then we show the second part of the lemma, 
that is |E[e(PA(xi,..., Xfc)]| ^ 5. 

Suppose without loss of generality that the following is true. 

• A' 7 ^ 0 for some i G [C]. 

• Li is maximal in the sense that for every j 7 ^ 1, either X[ j = 0 for all i G [C] or wtaiwj^s) < 
wta{wi^s) for some s G [£]. 

For a = (oi,..., a^) G and y GlKP and P : IK” —)■ T, define 

Da,yP{xi, ...,xe) = P{xi + aiy, ...,xii + a^y) - P{xi,..., xfi). 

Then 

^a,y {Pi Ljfixi, ... , xfi) {D^j (a)yffi'){^j {xi, ... , xf)'). 

Let A = wtc(Li) ^ d. Define oi,..., ua be the set of vectors of the form {—w, 0,..., 1,0,... , 0) 
where 1 is in the Ah coordinate for i G \2.,P\ and for all re G IK satisfying 0 ^ vjta{w) < vjtffiwij). 
Note that (Pi, a^) 7 ^ 0 for A: G [A] but for any j > 1 there exists some k G [A] such that {Lj,ak) = 0. 
Thus, 

... .[^{{D (iA,yA * * * Dai.yiPA){xi,... ,xe))] = 

The rest of the analysis is same as Theorem 3.3 in [BFH“^13] and we skip it here. □ 

®Here, deg(-) refers to the additive degree. 


C 




Z=1 
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We can now use Lemma 3.2 to prove our result on equidistribution of regular factors over affine 
subspaces of K”. 

Theorem 3.3. Let e > 0 Let B be a polynomial factor defined by polynomials Pi,... ,Pc : IK”' —>■ T 
with respective additive degrees di,... ,dc G and depths ki,... ,kc G . Suppose B has rank 
at least r^‘^'^^\d,e) where d = max((ii,..., dc)- Let A = {Li,..., L^) be a weight-closed affine 
constraint. For every i G [c], define Aj to be the set of tuples (Ai,..., Am) G — 1] such that 

J2JLi = 0 for 0,11 polynomials Qi with the same additive degree and depth as Pi. 

Consider (oij : z G [c], j G [m]) G such that for every i G [c] and for every (Ai,..., Am) G Aj, 
Yl]Li = 0. Then: 

Prxi,...,a;,eK"[^(Aj(xi,.. .,xi)) = (aij,.. .,ac,j) Vj G [m]] = ± e 


Proof. 


[B{Lj{xi,..., Xi)) = {aij,..., Ocj) Vj G [m]] 


= E 

Xl,...,X£ 


\ m 


Ai j—0 




2 p _^ 

n e{\ij{Pi{Lj{xi,.. .,xe)) - aij)} 


— (/Cj + l) 


E 

(^ij) 


e - 






1 E 


/ 



y ^ ^i,jPfiLj(xi, . . . , Xg)) 




= . JJlAil ± £p^^U(ki+l) 

Vi=l / 


The last line is due to the observation that from Lemma 3.2, X)i=i YljLi K,jPiiLj{xi,..., xg)) = 0 
if and only if for every i G [c], (Ajq,..., Xi^m) G Aj (mod So, Ylij is identically 

0 for Hi |A j| many tuples (Ajj) and for those tupes, Ylij = 0 also. 

□ 


Note that in Theorem 3.3, if e is a constant, m needs to be bounded for the claim to be 
non-trivial, which in turn requires that the affine forms in L be of bounded weight. 


3.2 Preservation of Locally Characterized Properties 

Theorem 3.4. Let V C {K.” ^ K} be a K,W-lightly locally characterized property. For an 
integer d, suppose Pg,..., Pc : IK” —>■ T are polynomials of additive degree ^ d, forming a factor 
of rank > r^ ^{d,K), and L : —)■ K. is a function such that F : IK” —> IK defined by F{x) = 

r(Pi(x),..., Pc{x)) satisfies V. 

For every collection of additive polynomials Qg,... ,Qc ■ IK” —>■ T with deg{Qi) ^ deg(Pj) and 
depth(Qj) ^ depth(Pj) for all i G [c], if G : IK” ^ IK is defined by G{x) = r{Qg{x),... ,Qc{x)), 
then G G "P too. 

Proof. For the sake of contradiction, suppose G ^ V. Then, for a weight-closed affine constraint 
consisting of K' linear forms Lg,..., L^', there exist xi ,... ,xg such that {G{Lg{xg, ..., xg )),..., 
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G{Lxi{xi ,..., xi))) which form a witness to G ^ V. Note that K' is a function of only K and W 
because the affine forms characterizing V can be made weight ^ VK by a choice of basis for K over 
F and then completed into a weight-closed constraint. So, there exists xi,...,Xi € K.” such that 
the tuple B = {Qi{Lj{xi ,..., Xi)) : j G [K'],i G [c]) G is a proof of the fact that G ^V. 

Now we argue that there exist x'l,... ,x'^ such that {Pi{Lj{x'i,... ,x'^)) : i G [c],j G [K]) equals 
B, thus showing that F ^ P, & contradiction. Notice that B satisfies the conditions required of a 
in Theorem 3.3. So by Theorem 3.3, 

[{Pi{Lj{x'i,...,x[) :i£ [c],j G [K]) = .B] > 0 

if the rank of the factor formed by Pi,..., Pc is more than (d, 2 ||B||ir ^; where ||B|| = 

pELi('^®pth(T)+i)^ □ 

In our applications, we will use Theorem 3.4 for the property of having bounded degree, which 
is lightly locally characterized by Theorem 2.6. 

4 List decoding of RM codes 

We state the following corollary which we need in the proof to follow. We only state a special case 
of it which is enough. 

Corollary 4.1 (Corollary 3.3 of [BL14]). Let g : K ^ K, e > 0. Then there exist c ^ 1/e^ 
functions hi,h 2 ,.. . ,hc G RMK(n, d) such that for every f G RMK(n, d), there is a function Tj : 
IK'^ —>■ K such that 


Pra;[r f{hi{x),..., hc{x)) = f{x)] ^ Pr^[g{x) = f{x)] - s. 

Theorem 1.1 (Restated). Let IK = Fg be an arbitrary finite field. Let e > 0 and d,n G N. 
Then, 

%(d, n, 6 K{d) - e) ^ Cq^d,s- 

Proof. We follow the proof structure in [BL14]. Let g : IK** —)• IK be a received word. Suppose 
Pr[g(x) = f{x)] ^ 1 — (5]K(d) -|- s. Apply Corollary 4.1 with approximation parameter e/2 gives 
P-o = {hi,..., he} T RMK(n, d), c ^ 4/e^ such that, for every / G RM]K(n, d), there is a function 
rj : IK'^ —7> IK satisfying 

Pr[r/(/ii(x), h 2 {x),..., hc{x)) = f{x)] ^ Pr[g'(x) = f{x)] - e/2 ^ 1 - 6 K{d) + e/2. 

Let ai, 02 ) ... ,ar he an arbitrary basis for K. over F. Let 5{d) := S^id). By Proposition 2.1, 

Pr[T'f{TT{aihj{x)) : 1 ^ i ^ r,l ^ j ^ c) = F(Tr(ai/(x)) : 1 ^ i ^ r)] ^ 1 - 6{d) -b e/2, 

where T^ : F^'^ —K and F : F^ ^ IK. From here onwards, we identify F with Ui. Let V. = 
{Tr{aihj{x)) : 1 ^ i ^ r,l ^ j ^ c} and TLf = {Tr(ai/(x)) : 1 ^ z ^ r)}. 

Let ri,r 2 : N —>■ N be two non decreasing functions to be specified later, and let be as 

given in Lemma 2.11. We will require that for all m ^ 1, 

ri(m) ^ r 2 iGlf}^\m + 1)) -b -b 1) -b 1. (2) 
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As a first step, we ri-regularize % by Lemma 2.11. This gives an ri-regular factor B' of degree 
at most d, defined by polynomials Hi,... ,Hc : ^ T, d ^ and rank(0') ^ ri(c'). 

We denote H' = {iLi,..., L^c'}- Let depth(Lfi) = ki for i G [d]. Let Gf : (8)f=iUfc.+i —>■ Ui be 
defined such that 

Ffihiix),hc{x)) = Gf{h'i{x ),... , h'^i{x)). 

Next, we will show that / is measurable with respect to H' and this would upper bound the 
number of such polynomials by d{q,d,e) independent on n. 

Fix such a polynomial /. Call Fi = Tr(ai/). Appealing again to Lemma 2.11, we r 2 - 
regularize Bf := B'^jl-Lp- We get an r 2 -regular factor B” B' defined by the collection 

H” = {Hi,... ,Hc'.,H[,... Note that it is a syntactic refinement of B' as by our choice 

of ri, 


rank(^') ^ ri(c') ^ T 2 {G''^;}^\d + 1)) + G';^J^\d + 1) + 1 ^ r 2 (|^"|) + \B''\ + 1. 
We will choose r 2 such that for all m ^ 1, 


,( 2 . 11 ). 


r 2 {m) = max 


/ 

( 

\ 

\ 

^(3.1) 

' d 

e/4 


(3.4), , 
,rj fim) 

l+i'' 

m 

\ 



/ 


(3) 


Since each is measurable with respect to B”, there exists T' ; S —)• Ui such that 


f{x) = F'{Hi{x),... ,Hc'{x),H'i{x),.. .,H{„{x)). 


Summing up, we have 


Fv[G{Hi{x),H2{x),...,H,,{x)) 


F'{Hi{x), ...,H,,{x),H{{x),..., H{„{x))] ^ 1 - S(d) + e/2. 


We next show that we can have each polynomial in the factor have a disjoint set of inputs. This 
would simplify the analysis considerably. 

Claim 4.2. Let x^,y^, i G [d],j G [c"] he pairwise disjoint sets o/n G N variables each. Let 
n' = n{d + c"). Let f : K" —>■ K and g : IK”' —>■ IK 6e defined as 

fix) = F{Hi{x^),..., H,,{x^'), H'liy^),..., H{„{y^'')) 


and 


~g{x) = G{H{{x^),...,H,,{x^)). 


Then deg(/) ^ d and 

Pr^gF"'[/(®) =9{x)] - Pra,6F"[/(a;) = Gf{h'i{x),h 2 {x),...,h{{x))] < e/4. 

Proof. The bound deg(/) ^ deg(/) ^ d follows from Lemma 3.4 since r 2 {\H"\) ^ r^^'^\\H"\). To 
establish the bound on Pr[/ = g], for each s G 5 let 


pi(s) = Pra,6F"[(/i'i(a^)> • • • > K'{x), h'iix),..., h'fiix)) = s\. 
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(3 1) 

Applying Lemma 3.1 and since our choice of r 2 satisfies rank('H") ^ ■ {e/A\S\)^ we have that 

Pi is nearly uniform over S, 

l±e/4 


Pi{s) = 


| 5 | • 


Similarly, let 


P2{s) = = s]. 




Note that the rank of the collection of polynomials ..., h'^,{x^'), h'({y ^),..., de¬ 

fined over F” cannot be lower than that of . Applying Lemma 3.1 again gives 


P2{s) 


l±e/4 


For s S, let s' G be the restriction of s to first c' coordinates, that is, s' = (si,..., Sc')- 

Thus 


Pr,,gFn'[/(x) = g{x)] = ^P 2 (s) 1 f(s)=g^( 6 ') 

ses 

= '^Piis)'i-F(s)=Gfis') ±e/4 
ses 

= Pr 2 ,eF-[/(x) = Gf{h'^{x),h' 2 ix),... ,h'^{x))] ± e/A. 

□ 

So, we obtain that 


Pr,j,gFn'[/(x) = g{x)] ^ Pr,,gF-[/(x) = Gf{h'i{x),.. .,h'^,{x))] - e/4 ^ 1 - 5{d) -Fe/4. 


Next, we need the following variant of the Schwartz-Zippel lemma from [BL14]. 

Claim 4.3. Let d,ni,n 2 € N. Let fi : Qjid ^ K 6e such that deg(/i) ^ d 

and 

Pr[/i(xi,... ,x„i+n 2 ) = / 2 (xi,...,XnJ] > 1 - 5((i) 

Then, fi does not depend on Xn^+i-, ■ ■ ■ ■,Xnx+n 2 - 

With claim 4.3 applied to fi = /, /2 = g, ni = nc', n 2 = nc". We obtain that / does not depend 
on ..., . Hence, 


fix\...,x''\y\...,y'^") = F{H',ix^),...,H'Ax‘^'),Gi,...,GF') 
where Gj = H"(0) for j G [c"]. If we substitute = ... = x'^^ = x we get that 

fix) = F(H;(x), .. .,H'Ax),H'fix), ... ,H/„(x)) = F(H;(x), ..., H',(x), Ci,..., C,»), 


which shows that / is measurable with respect to Li', as claimed. 

□ 
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5 Polynomial decomposition 

Definition 5.1. Given fc € N and A = (Ai,..., A^) € and a function T : ^ K., a function 

P : K" ^ K is [k, A, T)-structured if there exist polynomials Pi,... ,Pk : K” —)> K with deg(Pi) ^ Aj 
such that for x G we have 

P{x) = TiPiix),...,Pk{x)). 

The polynomials Pi,... ,Pk form a {k, A, T)-decomposition. 

The main result we prove is the following. 

Theorem 5.2. Let A; G N. For every A = (Ai,..., A^) G and every function T : —>■ K, there 

is a randomized algorithm A that on input P : K"" ^ K o/ degree d, runs in time poly^ ^ 
and outputs a {k. A, T)-decomposition of P if one exists while otherwise returning NO. 

We first show that the notion of rank is robust to hyperplane restrictions over nonprime fields. 
More precisely, we have the following. 

Lemma 5.3. Let P : IK"’ —>■ T 6e an additive polynomial such that rank(P) ^ r. Let H be a 
hyperplane in K". Then the restriction of P to H has rank at least r — q. 

Proof. Without loss of generality, let H be defined by xi = 0. Let P' : 1K"“^ ^ T be the restriction 
of P defined by P'{y) = P{0y). Let -n- : K" —>■ ]K"“^ be the map Tr{xiX 2 ... Xn) = X 2 ... Xn. Let 
P" : IK" ^ T be defined by P"{x) = P{x) — P' o tt. Then P"{x) = 0 for x G LA. For z G IK \ {0}, 
let hi = {i,0,... ,0). Then, for y £ H, define Rj : IK" ^ T by 

Rjiy) = P"{y + h,) = iD„^P"){y). 

Note that deg{Rj) ^ d — 1. Now, since P{x) = P''{x) + P' o tt{x), we have 

P{x) = r(P' o TT, xi, {Ryix) : y G F}). 

Now, if rank(P') ^ r, then rank(P'o7r) ^ r and hence rank(P) ^ r + g. This finishes the proof. □ 
We now start with the proof of Theorem 5.2. 

Proof. Let Pi : N —?> N be defined as Ri{m) = R 2 {c^^l^'i^\m + k)) + + k) + q where 

P 2 : N —)■ N will be specified later. 

Let ai ,..., Or be an arbitrary basis for IK over F. By Proposition 2.1, P{x) = Yhi /3iTr(ajP(x)) 
for the dual basis /3i,..., Set fi{x) = Tr(aiP(x)). Identifying F with Ui we treat fi : K" —)> T. 
Regularize {/i,..., /,.} using the algorithm of [BHT15] to find Pi-regular B = {gi,... ,gc ■ IK”" —^ 

T} where C ^ So, fi{x) = Gi{gi{x),.. .,gc{x)) and P{x) = YjiOtiGi{gi{x),.. .,gc{x)). 

Thus, if n ^ Cd, then we are done by a brute force search. 

Else, n > Gd. For each g^, pick a monomial with degree deg(Pj). Then there is zq G [n] such 
that Xjg does not appear in any g^. Set g[ := gi\xiQ = 0. Let B' be the factor defined by the g[s. 
Note that deg( 5 (') = deg( 5 i) and depth( 5 (') = depth(gj). Also, by Lemma 5.3, B' is Pi — g-regular. 

Now, using recursion, we solve the problem on n — 1 variables. That is, decide if for P' := 
P\xiQ = 0 is (fc, A, r)-structured. If P' is not, then P is not either, so we are done. Else, suppose 
the algorithm does not output NO. 
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Say 

P'{x) = T{Si{x),... ,Sk{x)) = r'(Tr(aj5i(x)) :i G [k],j € [r]), 

where 

T'{aij : i G [k\,j G [r]) = T(^f3iaij : i G [k]). 

j 

Note that while F : IK^ —>■ K., we have F' : K. Let Bi be the factor formed by {Tr(ajS'i)}. Via 

the algorithm of [BHT15], regularize B' U Bi using i22 : N ^ N and we get a syntactic refinement 
B' U B[ by the choice of Ri. Let B[ = , s'^}. where 

Tr(ajS’i) = Gij{g'i,s'j : i e [C],j e [D]). 

Choose large enough such that the map induced by B' U B'l is surjective. Now, fix any £ G [r]. 
Then, 

Tr(a,P') = Giig[, ...,g'c) = Fe{G,j{gi s')), 
where Fi = Tr(Q;£F'). Thus, for ai,..., ac, bi,.. .bo G F, 

G£(ai,... ,ac) = Fi{Gij{ai, ...,bD)-i^ [G],j G [D]). 

Substituting, ai = gi{x) and hj = 0 we have 

Tr(a£P) = Gi{gi,...,gc) = Fi{Gij{gi,Q)). 


Now, 

Tr(a^P) = TV(a^F(Q, : i G [k])), 

where Qi{x) = 'E'j=i (^jGijig-, ..., 0). 

Since, this is true for all i ^ [r], we have 


P{x) = F((5i(x),..., Qfc(x)). 
where Qi is defined as above. This finishes the proof. 


□ 
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